ERROR TOLERANCE IN CNNs . APPLICATION TO THE DESIGN OF ROBUST CNNs

نویسندگان

  • Mancia Anguita
  • Francisco J. Pelayo
  • F. Javier Fernández
  • Antonio F. Díaz
چکیده

This paper deals with the obtention of robust parameter configurations for DT-CNNs and for a class of CT-CNNs (here called CT-CNNs with Discrete Configurations, DC-CT-CNN), in the presence of additive and multiplicative implementation errors. Expressions that characterize the tolerance to both multiplicative and additive errors caused by circuit inaccuracies in DT-CNNs and DC-CT-CNNs VLSI implementation are first deduced. Taking into account those expressions it is proposed to obtain robust parameter configurations, by using a design process based on local rules, as the solution of a single linear programming problem. The process is applied to the generation of robust configuration for some tasks. The tolerance to errors of these configurations has been corroborated by simulations. The differences in parameter values and tolerance to errors, between the robust configuration obtained for solving a particular task in DT-CNNs and that obtained in DC-CT-CNNs, are given. 1.INTRODUCTION The Cellular Neural Network model proposed by L. O. Chua and L. Yang [1] has been widely used for image processing tasks [2]. The time evolution of the state of a cell (neuron or pixel) c in an NxM-cell CNN is described by the differential equation [1]: where n denotes a generic cell belonging to the neighbourhood of cell c, NR(c), with radius equal to R (for example, N1(c) is the set of 3x3 cells centred on c, N1(c)={ c-N-1, c-N, c-N+1, c-1, c, c+1, c+N-1, c+N, c+N+1}). xc is the state of cell c, yn and un are the output and the input, respectively, of the cell n, I is an offset term, and the matrices A and B are called feedback and control templates respectively. Some authors have proposed [3] a discrete-time (DT) version of CNN obtained by applying the Euler integration algorithm to discretise the cell state equation. The state of a cell c in an NxM-cell DT-CNN is described

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

An Information-Theoretic Discussion of Convolutional Bottleneck Features for Robust Speech Recognition

Convolutional Neural Networks (CNNs) have been shown their performance in speech recognition systems for extracting features, and also acoustic modeling. In addition, CNNs have been used for robust speech recognition and competitive results have been reported. Convolutive Bottleneck Network (CBN) is a kind of CNNs which has a bottleneck layer among its fully connected layers. The bottleneck fea...

متن کامل

Convolutional Gating Network for Object Tracking

Object tracking through multiple cameras is a popular research topic in security and surveillance systems especially when human objects are the target. However, occlusion is one of the challenging problems for the tracking process. This paper proposes a multiple-camera-based cooperative tracking method to overcome the occlusion problem.  The paper presents a new model for combining convolutiona...

متن کامل

Cystoscopy Image Classication Using Deep Convolutional Neural Networks

In the past three decades, the use of smart methods in medical diagnostic systems has attractedthe attention of many researchers. However, no smart activity has been provided in the eld ofmedical image processing for diagnosis of bladder cancer through cystoscopy images despite the highprevalence in the world. In this paper, two well-known convolutional neural networks (CNNs) ...

متن کامل

Hand Gesture Recognition from RGB-D Data using 2D and 3D Convolutional Neural Networks: a comparative study

Despite considerable enhances in recognizing hand gestures from still images, there are still many challenges in the classification of hand gestures in videos. The latter comes with more challenges, including higher computational complexity and arduous task of representing temporal features. Hand movement dynamics, represented by temporal features, have to be extracted by analyzing the total fr...

متن کامل

Reduced-Precision Strategies for Bounded Memory in Deep Neural Nets

This work investigates how using reduced precision data in Convolutional Neural Networks (CNNs) affects network accuracy during classification. Unlike previous work, this study considers networks where each layer may use different precision data. Our key result is the observation that the tolerance of CNNs to reduced precision data not only varies across networks, a well established observation...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2001